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J£ ■ Abstract 

Galaxy redshift surveys provide a distorted picture of the universe due to the non-Hubble com- 
ponent of galaxy motions. By measuring such distortions in the linear regime one can constrain 
the quantity (3 = f2 0,6 /6 where Q is the cosmological density parameter and b is the (linear) bias 
factor for optically-selected galaxies. In this paper we apply two techniques for estimating (3 from 
the Stromlo-APM redshift survey — (1) measuring the anisotropy of the redshift space correlation 
function in spherical harmonics and (2) comparing the amplitude of the direction-averaged red- 
shift space correlation function to the real space correlation function. We test the validity of these 
techniques, particularly whether the assumption of linear theory is justified, using two sets of large 
iV-body simulations. We find that the first technique is affected by non-linearities on scales up to 
~ 30/i -1 Mpc. The second technique is less sensitive to non-linear effects and so is more useful for 
existing redshift surveys. 

The Stromlo-APM survey data favours a low value for (3, with (3 < 0.6. A bias parameter b ~ 2 
is thus required if O = 1. However, higher-order correlations measured from the APM galaxy 
survey (Gaztahaga and Frieman 1994) indicate a low value for the bias parameter b ~ 1, requiring 
that $7 < 0.5. We also measure the relative bias for samples of galaxies of various luminosity and 
morphological type and find that low-luminosity galaxies are roughly three times less biased than 
L* galaxies. For the galaxy population as a whole, we measure a real space variance of galaxy 
counts in 8/i _1 Mpc spheres of (<7g) 5 = 0.89 ± 0.05. 

Subject headings: galaxies: clustering — galaxies: distances and redshifts — galaxies: fundamental 
parameters — large-scale structure of universe — surveys 
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1 Introduction 



Galaxy redshift surveys can provide some of the most important constraints on theories of large- 
scale structure, but they must be analysed with care. For pure, unperturbed Hubble flow, galaxy 
clustering measured in redshift space would be isotropic and identical to that measured in real space. 
However, in practice, peculiar velocities will distort the redshift space correlation function. Since the 
amplitude of peculiar velocities depends on the cosmological density parameter Q, measurements 
of this distortion can constrain the value of O. On small scales, the effect of peculiar velocities is 
to elongate clusters of galaxies along the line of sight in redshift space, leading to the well known 
'fingers of God'. However, on large scales, coherent bulk flows dominate the peculiar velocity 
field resulting in a compression in the clustering pattern along the line of sight. This effect is 
easily seen in the Stromlo-APM Survey as shown in Figure 1, which is a contour plot of the full 
redshift space correlation function £(cr, it) as a function of components of separation parallel (tt) 
and perpendicular (<r) to the line of sight. A compression of the low-amplitude £ contours in the tt 
direction compared with the a direction is clearly visible for ir > 10/i~ 1 Mpc. (We assume a Hubble 
constant of Hq = lOO/i km/s/Mpc.) 

This large-scale anisotropy in redshift space clustering is most naturally expressed in terms of the 
power spectrum. Kaiser (1987) has shown that in the linear regime of gravitational instability 
models, the power spectra in redshift space, P s (k) and real space P r (k) are simply related by 

P a (k) = (l + /^) 2 P r (k), (1) 

where ^k is the cosine of the angle between the wavevector k and the line of sight. The amplitude of 
the distortion is determined by the parameter j3 = f(ft)/b, where f(Q) ~ r^ ' 6 is the dimensionless 
growth rate of growing modes in linear theory. The bias parameter b relates the fluctuations in galaxy 
density to the underlying mass density in the linear regime, 5 g = b5 p for linear bias. Several practical 
methods for measuring f3 have recently been applied: measuring the anisotropy of the correlation 
function (Hamilton 1992, 1993a; Fisher et al. 1994a), the anisotropy of the power spectrum (Cole, 
Fisher and Weinberg 1994, 1995; Tadros and Efstathiou 1996) and spherical harmonics of the density 
field (Fisher et al. 1994b; Heavens and Taylor 1995). 

We follow the correlation function approach in this paper .[] Hamilton (1992) has pointed out that 
the cosine ^k in Fourier space transforms to an operator in real space: 

£,(r, /i) = [1 + P(d/dz) 2 (V 2 )- l ] 2 Hr(r), (2) 

where (V 2 ) -1 denotes the inverse Laplacian operator and [i = r.z is the cosine angle between pair 
separation r and the line of sight z. The redshift space correlation function £ s (r, \x) is conveniently 
expressed as a sum of spherical harmonics involving the first three even-order Legendre polynomials, 
(the odd-order harmonics vanish by pair-exchange symmetry) 

&r, m) = £o(r)PoGu) + &(r)JM/*) + U(r)Piin). (3) 

Hamilton gives expressions for the £i(r) in terms of integrals over £ r ( r ) [his equations (6)— (9)]. 

To solve the inverse problem, i.e. to go from redshift space clustering to real space clustering, 
Hamilton integrates the equations describing the real and redshift space correlation functions over 

For a power spectrum analysis of the Stromlo-APM survey, see Tadros and Efstathiou (1996). 
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planes normal to the vector r at separation r, expands in spherical harmonics and differentiates with 
respect to r. He thereby obtains an explicit expression for (3 and £ r ( r ) in terms of the harmonics 
£l(r) of the redshift space correlation function. Further volume averaging to minimize cancelation of 
terms finally results in an equation for j3 involving the Oth and 2nd order harmonics of the redshift 
space correlation function: 



One can also write a similar expression involving the 2nd and 4th order harmonics, but in practice, 
the 4th order harmonic is too noisy and too strongly affected by non-linear effects to be useful. 

As well as causing anisotropy in redshift space, large-scale streaming motions also produce an ampli- 
fication in the direction-averaged redshift space correlation function on large scales. For fluctuations 
in the linear regime, the direction-averaged redshift space correlation function £(s) and the real space 
correlation function £(r) are related by (Kaiser 1987) 



The large uncertainty in the value of [3 hinders comparison of ^(s) with real space predictions of 
galaxy clustering from various models (see, for example, Loveday et al. 1992a). In a recent paper 
(Loveday et al. 1995, hereafter Paper 2), we estimated the real-space correlation function of optically- 
selected galaxies by cross-correlating galaxies in the sparse-sampled Stromlo-APM Redshift Survey 
with the fully-sampled, parent APM Galaxy Survey. This projected cross-correlation function is 
unaffected by redshift-space distortions and may be stably inverted to give the real-space correlation 
function £(r). Moreover, the large number of cross-pairs enables clustering to be measured to smaller 
scales than using the redshift survey data alone. If both £(r) and £(s) can be reliably measured in 
the linear regime then the value of (3 can be constrained using equation (|5|). 

We assess the relative merits of these two methods of estimating fi (equations |] and ||) by analyzing 
iV-body simulations. The two sets of simulations, of low and high density, are designed to be similar 
to the Stromlo-APM data in both the clustering and dynamics of the galaxies. In particular, we 
estimate the sensitivity of the methods to non-linear dynamics of the galaxy distribution. 

The above expressions (1-5) assume a plane-parallel approximation for peculiar displacements. In 
order to approximate this ideal in our analyses, we use only those pairs of galaxies separated by 
less than 50 degrees on the sky. This rejects about 20% of galaxy pairs, and, as Cole et al. (1994) 
have demonstrated, will limit deviations from the plane-parallel approximation to no more than a 
5% bias in the estimated value of f3. 

Throughout the paper, we use r to denote real space separations and s to denote separations in 
redshift space. Error bars on measurements from survey data are estimated using the bootstrap 
resampling technique (Barrow, Bhavsar and Sonoda 1984) with nine bootstrap resamplings of the 
survey. Error bars for simulations are determined from the variance between ten independent 
realizations of the low-density model and nine realizations of the high-density model. 

The layout of the paper is as follows. The Stromlo-APM survey data and the iV-body simulations 
are described and compared in §|2[ In §H] we test the estimators for (3 using the simulations. In §|| 
we apply the estimators to the Stromlo-APM data and also present the relative bias and redshift 
space distortions for different galaxy types. Finally, our conclusions are given in §[|. 




(4) 




(5) 
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2 Survey Data and N-Body Simulations 



Both equations (|j) and (||) assume that linear theory is valid on scales on which £ can be reliably 
measured. It is important to test this assumption of linearity before using these equations to estimate 
[5. We do this by analyzing two ensembles of CDM-like iV-body simulations. In this section we 
describe the Stromlo-APM survey data and the simulations, and show that the simulations mimic 
the observed clustering and dynamics of the galaxy distribution quite faithfully. 

2.1 Stromlo-APM Survey Data 

The Stromlo-APM redshift survey consists of 1787 galaxies with bj < 17.15 selected randomly at a 
rate of 1 in 20 from the APM (Automated Plate Measuring) galaxy survey (Maddox et al. 1990a, b). 
The survey covers a solid angle of 1.3 sr (4300 square degrees) in the south galactic cap. The APM 
magnitudes have been calibrated and corrected for photographic saturation using CCD photometry 
as described by Loveday et al. 1992b (hereafter Paper 1). An approximate morphological type was 
assigned to each galaxy by visually inspecting the images on the United Kingdom Schmidt Telescope 
(UKST) survey plates. Redshifts were obtained with the Mount Stromlo-Siding Spring Observatory 
(MSSSO) 2.3m telescope at Siding Spring. Measured radial velocities were transformed to the local 
group frame using v = v + 300sin(/) cos(6) and we assumed A = 0, qo = 0.5 and Hq = 100 
km s _1 Mpc _1 with uniform Hubble flow in calculating distances and absolute magnitudes. We 
adopt /c-corrections for different morphological types in the bj system as described by Efstathiou, 
Ellis and Peterson (1988). More details about the survey are given in Paper 1 and the construction 
of the survey is described in full by Loveday et al. (1996). 

2.2 Simulations 

We use the two sets of iV-body simulations described by Croft and Efstathiou (1994); a low-density 
CDM model with f^o = 0.2 and a cosmological constant (LCDM) and a mixed dark matter model 
with Qq = 1 (MDM). We analyze ten realizations of the LCDM model and nine realizations of 
the MDM model. These simulations combine a large volume (box length = 300/i _1 Mpc) with 
a force resolution of ~ 80/i _1 kpc for 10 6 particles, and so can be used to generate reasonable 
approximations to our redshift survey. Both sets of iV-body simulations have enhanced large-scale 
power compared with the standard CDM model; the LCDM model by having T = QqIi = 0.2 and 
a nonzero cosmological constant A = A/(3Hq) = (1 — Qo) = 0.8 and the MDM model by having 
Q. v = 0.3 from neutrinos and h = 0.5. 

In order to generate mock Stromlo-APM catalogues from the simulations, 'galaxies' were selected 
within the APM area and with the Stromlo-APM selection function (Paper 1), such that they 
traced the mass particles in an unbiased way. This procedure produces mock catalogues of on 
average 33,500 'galaxies' each. We select a subset of 1 in 20 galaxies at random from each simulated 
catalogue in order to mimic the sparse sampling strategy of the Stromlo-APM survey. The intrinsic 
value of (3 for the simulations is, by construction, (3 = 0.38 for the LCDM simulations and (3=1 
for the MDM simulations. 
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2.3 Galaxy Clustering in Real and Redshift Space 



We estimate the redshift-space correlation functions from the survey and the simulations using the 
density-independent estimator for £(s) discussed in Paper 2, 



Here w gg (s), w gr (s) and w rr (s) are the summed products of weights of galaxy-galaxy, galaxy-random 
and random-random pairs respectively. Note that the relative densities of galaxy and random points 
measured at separation s are automatically accounted for by this estimator — there is no need to 
assume an overall galaxy density n g . This estimator, due to Hamilton (1993b), is insensitive to 
variations in galaxy density and provides a very stable estimate of 

To calculate the real-space correlation function £(r), we measure the projected cross-correlation 
function between the redshift data and the angular data from the fully-sampled parent catalogue, 



where the integral extends over all line-of-sight separations Ay for pairs of galaxies with given 
projected separation a = yO (9 is the angular separation and y is the distance to the galaxy of 
known redshift). This projected function is inverted numerically to give an estimate of which 
is unaffected by redshift-space distortions. See Saunders et al. (1992) and Paper 2 for a detailed 
description of this estimator. 

In Figure [2] we compare the clustering of galaxies in (a) redshift space and (b) real space for the 
Stromlo-APM survey and for the iV-body simulations. The error bars show the scatter between 
nine bootstrap resamplings of the survey. The measured variance between the different realizations 
of the simulations yields similar error bars, which are not plotted here for the sake of clarity. We 
see that the simulations match the observed clustering of galaxies reasonably well on large scales, 
although on small scales the LCDM models overpredict and the MDM models underpredict the 
observed clustering. The plateau in the real-space clustering of Stromlo-APM galaxies at r ~ 20- 
30/i _1 Mpc appears to be significant given the size of the random errors. However, as discussed in 
Paper 2, £(r) inferred from inversion of the projected cross-correlation with the parent catalogue 
is subject to systematic error beyond r ~ 20/i -1 Mpc, although neither of the simulations shows 
any feature here. It is clear that we will need to check that we obtain consistent estimates of (3 on 
different scales if our results are to be completely trustworthy. 

We have fit power-laws to the correlation functions plotted in Figure ^. We fit over the range 
1.5 < s < 30 ft Mpc in redshift space and 0.2 < r < 20 ft Mpc in real space. The parameters to 
these power-law fits are given in Table 0. 

2.4 Galaxy Peculiar Velocities 

If the iV-body simulations are to be used to check for non-linear effects in the real data, then it is 
important to compare the amplitude of small-scale, virialized motions in the simulations with those 
in the data. By comparing estimates of clustering in redshift space and real space, one can constrain 
the galaxy peculiar velocity distribution f(w) (eg. Bean et al. 1983, Davis and Peebles 1983). The 




(6) 




(7) 
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redshift space correlation function £(<r, ir) is given by convolving the real space correlation function 
£(r) with f(w), 

/oo 
[1 + + ffo^(l + e)"V 3 ]^3, (8) 

-oo 

(Bean ei al. 1983), where r 2 = a 2 + r 2 , r 3 = 7r — w$/Hq (the subscript 3 denotes the line-of-sight 
component of a vector quantity) and (w) ~ —Hq/3£(1 + C) — r 3 * s the mean streaming velocity of 
galaxies at separation r. 

We have measured £(<r, 7r) in four c bins each of width 2/i _1 Mpc centred on 1, 3, 5 and 7/i Mpc 
- Figures ||a, 5 and c for the data, LCDM and MDM simulations respectively. We have calculated 
the best-fit rms peculiar velocity, (w 2 ) 1 ^ 2 , for three models for f(w), a Gaussian, 

1 / -w 2 \ 

a |to| 3 / 2 distribution, 



0.476 ( -0.7966\w\ 3 / 2 \ 

/H= (^ eXP l ( W 2)3/4 )' ( 10 ) 



and an exponential distribution, 



/H = ^1/9 ex P ( T^Stt I • ( n ) 



The optimum value of (w 2 ) 1 ^ 2 for each distribution was calculated by maximizing the likelihood 

~ -(£>^)-£>,7r)) 2 ~ 



C= Yl [2vrVar{e((J,^)}] _1/2 exp 

7T— bins 



2Var{£(<7,7r)} 



(12) 



where £°(<t, 7r) is the observed redshift space correlation function, Var{£(<r, 7r)} is the observed 
variance in £°(cr, tt) from bootstrap resampling (or from different realizations of the simulations) and 
£ p (<7, 7r) is the predicted correlation function from (||). We use the measured £(r) from Figure ||(b) 
in equation (||) and substitute f3 = 0.38 and j3 = 1 for the LCDM and MDM simulations respectively 
and assume f3 = 0.5 for the Stromlo-APM data (see §[|). The continuous, dashed and dot-dashed 
lines in Figure |3| are the best fit curves for the Gaussian, |u>| 3 / 2 and exponential models respectively. 
The best-fit values of (w 2 ) 1 ^ 2 together with 95% confidence limits as estimated from likelihood ratios 
are given m Table § 

For the survey data, we see that the exponential velocity distribution model gives a marginally 
better fit to the observations than the |w;| 2//3 or Gaussian distributions. There is no obvious trend 
of (w 2 ) 1 / 2 with separation a, the 95% confidence range for (w 2 ) 1 ^ 2 is roughly 100-1100 km s _1 , 
with a maximum likelihood value around 500 km s _1 . Note that our survey does not provide a 
strong constraint on small scale peculiar velocities simply due to the sparse-sampling strategy we 
have employed. It would be interesting to compare f{w) for the morphological and luminosity- 
selected subsamples defined in Paper 2, but unfortunately, the shot-noise errors on £(cr, n) for these 
subsamples are too large to test for variation of (w 2 ) 1 / 2 with galaxy type or luminosity. 

For both sets of simulations, the exponential model provides the best fit for the smallest a bin 
(er < 2/i~ 1 Mpc) but this model fairs less well at larger projected separation. In fact none of the 
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models for f(w) provides a very good fit to the simulations, which probably explains why (w 2 ) 1 ^ 2 
is being overestimated for the simulations at small a. (Using the position and velocity information 
for each galaxy in the simulations yields direct measurement of rms peculiar velocities of 350 km/s 
and 510 km/s for the LCDM and MDM model respectively.) Our fits to (w 2 ) 1 / 2 in Table || are 
giving close to the expected values for a 5/i _1 Mpc. We conclude that the LCDM model has 
slightly smaller peculiar velocities than the data, whereas peculiar velocities in the MDM model are 
comparable to those measured from the Stromlo-APM data. 



3 Testing Estimators for j3 

In the preceding section we showed that the simulations have comparable two-point clustering 
statistics and small-scale peculiar velocities to the survey data. One might naively expect that if 
the simulations obey linear theory at a certain scale then linear theory should also be applicable to 
the survey data on that same scale. However, as seen below, we find that the MDM simulations 
show evidence for non-linear effects to much larger scales than the LCDM simulations, despite the 
relatively small difference in small-scale peculiar velocities. As pointed out by Fisher and Nusser 
(1996), the departure from linear theory is due to non-linear streaming (as modelled, for example, 
by the Zel'dovich approximation), and not just due to virialized motions. 

In this section we investigate the scales on which linear theory is obeyed by the simulations, insofar 
as one can estimate (3 from the anisotropy of clustering in redshift space and from the amplification 
in £(s) in redshift space compared to real space. 



3.1 Anisotropy of £(cr, tt) 



We estimate the anisotropy in £(er, tt) as follows. The redshift space spherical harmonics £z(r) in 
equation (|j) are given by an integral over the full redshift space correlation function £(r,/j,), 



21 + 1 f 1 



2 j -i 



(13) 



where Pi(n) is the Ith order Legendre polynomial. We can measure £(r, jj) by comparing the 
observed, weighted sum of galaxy pairs w^dir, fj,) at separation r and direction cosine to line of sight 
(jl, with the expected background bgr(r, /i) for an isotropic, unclustered distribution. The line of 
sight direction is defined as the bisector in angle of each pair. 

Since Pi(/j>) is an odd function for odd I and an even function for even I, the odd-/ harmonics vanish 
and the even-Z harmonics are given by 



(21 + 1) f 1 
Jo 



(21 + l)A/i 



Wgg(r,^) 

bgr(r, //) 

WiWjPl(n) 



pairs(r) 



bgr(r, fx) 



1 ) Pl(ji)dn 



(14) 



Here we have replaced the integral over £(r, fx) with respect to [i by the weighted and appropriately 
normalised sum of Pi(fx) for all galaxy pairs at separation r. The W{Wj are the products of the 
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weights of each galaxy in the pair, given by equation (1) of Paper 2 and 5io is the Kronecker delta 
symbol, equal to unity for I = 0, zero otherwise. The background bgr(r, /i) is obtained by linear 
interpolation in \x from a pre-calculated look-up table. We do not interpolate between r-bins, since 
the £j(r) are calculated in the same separation bins in which bgr(r, \x) is tabulated. This look-up 
table is generated in ten fixed steps in Alogr and Afj, using a large catalogue of random points 
with the same selection function and within the same boundaries as the data, and using the same 
weighting scheme, 

bgr(r ^ )= J rr (r, M ) ■ (15) 

Here w gr (r, fx) and w rr (r,n) are the summed weights of galaxy-random and random-random pairs 
respectively. This definition of the background does not require one to estimate the mean density of 
the data and random catalogues to normalize £; instead the normalisation is determined using only 
those galaxies at separation r and cosine direction /x. Such an estimator gives more stable estimates 
of £ on large scales than traditional estimators (Hamilton 1993b; Paper 2). In Figures |I]a and b 
we plot the £;;(r) measured from the LCDM and MDM simulations respectively as the points with 
error bars. Also shown by the curves are the linear-theory predictions for the £z(r) using equations 
(6)-(9) of Hamilton (1992). 

For the LCDM model (Figure ||a), we use the power spectrum of Efstathiou, Bond and White 
(1992) with r = 0.2 and = 0.38. In this theory, V = Q,qK determines the shape of the real-space 
correlation function, and determines the redshift-space distortions. Since the simulations are 
unbiased, = 0[j- 6 = 0.38. We see that the direction-averaged correlation function £o measured 
from the simulations agrees well with linear theory on scales as small as 2/i _1 Mpc. Non-linearity is a 
far more severe problem for the quadrupole (£2) and hexadecapole (£4) harmonics. The quadrupole 
harmonic is expected to be negative in the linear regime (Hamilton 1992) and so we plot —£2 m 
Figure ||. The measured £2 is in fact positive on scales r < 15/i -1 Mpc suggesting that non-linear 
effects dominate £2 on these scales. The amplitude of £2 is lower than that predicted by linear 
theory until r ~ 30/i _1 Mpc, suggesting that non-linearity may affect £2 out to these scales. Beyond 
~ 55/i _1 Mpc the data is too noisy to measure £2 reliably. The hexadecapole harmonic £4 has 
an amplitude on scales r < 15/i -1 Mpc exceeding the linear theory prediction by several orders of 
magnitude (in fact it is comparable to the direction- averaged correlation £0) and on larger scales, 
it's measurement is too noisy to be useful. Equation (||) gives physically reasonable estimates of 
the quantity over a range of scales 21-42 /i^Mpc: = 0.06 ± 0.43, 0.47 ± 0.48 and 0.02 ± 0.35 
respectively at separations of r ~ 21, 30 and 42 /i -1 Mpc. Comparison with the linear theory curves 
suggests that the first of these estimates (at r ~ 21/i _1 Mpc) is probably biased low by non-linearity, 
but the second two estimates appear to be in the linear regime. 



For the MDM model (Figure [|b), we use the power spectrum of Klypin et al. (1993). Again, we see 
that the direction-averaged correlation function £0 agrees very well with linear theory over all scales 
measured but that £2 is only in reasonable agreement for scales r > 15/i _1 Mpc. The measured 
errors for £4 are very large on all scales, so we do not show the £4 estimates on this plot. At scales 
r w 21, 30 and 42 /T^Mpc, equation (|) provides estimates of of 0.30 ± 0.31, 0.39 ± 0.44 and 
0.61 ± 0.86, all of which underestimate the true value = 1. 
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3.2 Amplification of £(s) 



We have seen in the previous subsection that anisotropics in the redshift space correlation function 
only agree with the linear theory prediction on very large scales, where measurements from existing 
galaxy catalogues are too noisy to usefully constrain (3. In this subsection, we investigate how well 
one might measure (3 from the amplification of the direction-averaged correlation function in redshift 
space compared to real space. 

The ratio is subject to large random fluctuations in the linear regime where £(r) is small. 

Therefore, when estimating (3 from equation (|5|) it is desirable to either fit to (3 measured over a 
range of scales or alternatively to smooth the £ estimates before taking their ratio. A common way 
of smoothing £(r) is to take its volume integral 

J 3 (r) = f x 2 i(x)dx. (16) 
Jo 

With an iV-body simulation, one has the advantage of being able to estimate the real space corre- 
lation function directly by using the real space locations of the simulation galaxies in (|6|), as well 
as via inversion of the projected correlation function (0). The former estimate of £(r) is useful 
for studying effects of non-linearity in the simulations, whereas the latter, noisier, estimate gives 
a more realistic assessment of what we can hope to measure from real data. We have used the 
ratios £(s)/£(r) and Js(s)/J3(r) measured with both £(r) estimates in equation (]5|) to estimate (3 
on a range of scales. These estimates are presented in Figures | and | for the LCDM and MDM 
simulations respectively. 

For the LCDM simulations (Fig. |5|), we see that the ratio (open symbols) appears to 

converge to give the correct value of j3 by a scale r 5/i _1 Mpc, although the estimates are biased 
a little high. Beyond r ~ 20/i~ 1 Mpc, the measured correlation functions are too noisy to usefully 
constrain (3. We have calculated a maximum-likelihood fit to the four data points between 5 and 16 
/i _1 Mpc, and find that (3 = 0.56 with a 95% confidence range 0.44-0.68. The ratio Jz{s) / Jz(r) (solid 
symbols) is biased low by non- linear dynamics to larger scales (r ~ 20/i~ 1 Mpc), but by these scales 
is providing an almost unbiased and low-noise estimate of the true (3. The point at r = 17.8/i _1 Mpc 
yields (3 = 0.29 ±0.07 (one sigma error). The results using £(r) and J%{r) inferred from inversion of 
the projected correlation function (Fig. ||b) are only a little noisier than those determined from the 
direct estimates of £(r) and J%{r). Fitting to (3^ over the same four measurements provides (3 = 0.58 
with a 95% confidence limit 0.41-0.76 and #/ 3 (17.8) = 0.36 ± 0.13. 

For the MDM simulations (Fig. ^), we see that the ratio Ci s )/C( r ) (open symbols) does not converge 
so readily to the correct value of (3; it crosses (3 = 1 at r ~ 10/i _1 Mpc but then tends to overshoot 
slightly. Again, beyond r ~ 20/i~ 1 Mpc, the measured correlation functions are too noisy to usefully 
constrain (3. A fit to f3^ using the two measurements in the range 10-16 /i _1 Mpc provides the 
estimates (3 = 1.41 (1.00-1.83) and (3 = 0.93 (0.72-1.15) for the direct and inverted estimates of 
£(r) respectively. The ratio Js{s) / J?,{r) (solid symbols) converges to /3 = 1 by scales r w 20/i _1 Mpc; 
estimates on larger scales tend to overestimate (3, but most are within ~ la of (3 = 1. We measure 
A/ 3 (17.8) = 1-02 ± 0.16 and /3j 3 (17.8) = 0.85 ± 0.17 from Figs. | (a) and (b) respectively. 

One could consider using alternative, smoothed measures of the galaxy clustering which are less 
affected by small-scale peculiar velocities than J3. An example would be a modified form of the 
J3 integral in which the lower limit of integration is set at, say, r m j n = 5/i -1 Mpc. This was tried, 
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and while the contribution from peculiar velocities is indeed suppressed, the modified estimator is 
subject to larger random fluctuations than J3 as defined in fli~6|). 



3.3 Conclusions from Simulations 

We have analysed two ensembles of CDM-like iV-body simulations, one a low density (LCDM, 
= 0.2) model, and one high density (MDM, Qq = 1). Both give a reasonable match to the real 
and redshift space correlation functions measured from the Stromlo-APM Redshift Survey and have 
comparable peculiar velocities (w 2 ) 1 ^ 2 . We used these simulations to investigate the practicality 
of measuring the quantity (3 = Q®' e /b from (a) the anisotropy and (b) the amplification of the 
measured galaxy clustering in redshift space. 

For the LCDM simulations, we find that the 2nd and 4th order spherical harmonics of the redshift 
space correlation function are severely affected by non-linearities to scales r ~ 30/i _1 Mpc, and so 
one needs a reliable measurement of the £1 on scales r > 30/i _1 Mpc in order for linear theory to 
be applicable. This is in agreement with the Fourier-space harmonic analysis of Cole et al. (1994). 
The situation is even worse for the MDM simulations, where the 2nd order spherical harmonic 
underestimates (3 on all scales at which it can be measured reliably. 

By contrast, the amplitude of the direction averaged correlation function £0 is relatively weakly 
affected by non-linearity. For the LCDM model non-linear effects become unimportant on much 
smaller scales, r ~ 5/i -1 Mpc for £ measures and r ~ 20/i~ 1 Mpc for J 3 measures. The MDM 
simulations effectively agree with linear theory by scales of r ~ 10/i -1 Mpc for the £ measures and 
by r « 20/i~ 1 Mpc for the J3 measures. 

Thus the more practical method for determining (3 from current redshift surveys is by comparison of 
the direction-averaged redshift-space correlation function with the real-space correlation function. 
By using the J3 volume integral over £, one decreases the random noise in /3, at the expense of 
pushing out the effects of non-linearity to larger scales. In practice it will be worthwhile to estimate 
j3 from both £(s)/£(r) and J$(s)/ J$(r). We expect the J3 ratio to give the less noisy results. 



4 Results from Stromlo-APM Survey 
4.1 Constraints on (3 

We have measured the spherical harmonics £z(s) of the Stromlo-APM redshift space correlation 
function in the same way as for the simulations (§3.1). The results are shown as the points with 



error bars in Figure 0. The curves show the linear theory predictions for LCDM (light lines) and 
MDM (heavy lines). We see pronounced effects of non-linearity and very large error bars on the 
£2 harmonics on scales smaller than 20/i _1 Mpc. The direction-averaged correlation function £0 
is well matched by the LCDM linear theory prediction on all scales. The MDM model slightly 
under-predicts £0 ° n small and large scales (cf Fig. ^). The measured £2 harmonics agree quite well 
with the LCDM linear theory prediction on scales 20-50 h~ 1 Mpc whereas the MDM prediction is 
too high. In other words, we see evidence for smaller redshift space distortions than expected in 
an unbiased £Iq = 1 model. On scales of 21, 30 and 42 h Mpc, the estimated values of (3 are 
0.41 ± 0.17, -0.03 ± 0.29 and 0.23 ± 0.31 respectively. 
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From our analysis of simulated galaxy catalogues in the previous section, we expect the ratios of 
the direction-averaged clustering in redshift space and real space to give more reliable estimates of 
j3. In Figure ||, we plot our estimates of j3 from the redshift survey, as determined from the ratio 
£(s)/£(r) (open symbols) and from the ratio Jz{ s )/Jz{ r ) (solid symbols). The error bars in this figure 
are determined from the scatter between estimates of [5 for each of the nine bootstrap resampled 
surveys, and are in reasonable agreement with the scatter found between different realizations of 
the simulations (Figs. || and |6|) in the linear regime. There is a wide scatter in the f3 estimates 
from the £ ratios around 10-20 /i _1 Mpc, but the J3 ratios give consistent results over this range, 
appearing to favour f3 « 0.2-0.5. Even the point giving the largest value of /? (/? = 0.48 ± 0.12 at 
r = 17.8/i _1 Mpc) favours j3 <C 1. It is interesting to note that in both sets of simulations, the J3 
ratio at this scale provides an estimate of within 1 sigma of the correct value. Therefore (3 < 0.6 
would seem to be a reasonable upper limit allowed by our analysis and we conclude that either 
Slo < 1 or that galaxies are significantly biased tracers of the mass distribution, b> 2. 

As an aside, we note that the small-scale, non-linear, behaviour of (3 for the Stromlo-APM survey 
is markedly different to that of the simulations, which have a systematically negative (3 and smaller 
errors on scales r < 5/i _1 Mpc. We are not overly concerned by this as the simulations provide a 
relatively poor fit to observed clustering on small scales and we know that equation (||) is clearly 
not to be trusted in regimes in which it predicts a negative (3\ 

4.2 Disentangling Vt and b 

Ideally, of course, one would like to know the values of the density parameter O, and the bias 
parameter b individually. Cole et al. (1994) have discussed how it may be possible with future 
redshift surveys to separate the determination of £1 and b by studying the scaling of non-linear 
effects. An alternative approach is the study of high order correlations to constrain the (possibly 
non-linear) biasing model using weakly non-linear perturbation theory. Gaztahaga and Frieman 
(1994) have used high order moments of APM galaxies to constrain biasing models. To be consistent 
with non-linear perturbation theory, one should allow the possibility of non-linear bias, in which 
case second- and third-order non-linear bias coefficients can be chosen which match the observed 
high order correlations. However, the observations are very well fit by an unbiased, low-density 
CDM model with b ~ 1. Applying Occam's razor, this seems the more natural solution. 

4.3 Relative Biasing of Different Galaxy Types 

Despite the uncertainties in the value of galaxy bias with respect to the mass, one may study 
the relative bias of galaxies of different type by comparing their clustering properties. There are 
two independent ways to measure the relative bias factors: (1) by comparing real-space clustering 
in the linear regime and (2) by measuring the redshift space amplification of clustering due to 
equation (|5j). One thus has a consistency check on measurements of /? and relative bias parameters. 
We have already compared the clustering of galaxies of different luminosity and morphological 
type in Paper 2. In that paper we concentrated on the small-scale (power-law) regime of galaxy 
clustering. Here we study clustering in the linear regime. We analyse galaxy subsamples from the 
Stromlo-APM survey of low, middle and high luminosity, and of early and late type. These galaxy 
samples are defined in Table 1 of Paper 2. 
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In Figure ^ we plot the relative bias values = £tg(r) /£gg(?) (open symbols) and bj 3 = J3 9 (r) / J3 99 (r) 
(solid symbols) for each sample over a range of scales. We have divided the real-space cross- 
correlation of each sample with the parent APM galaxy sample (Paper 2) by the real-space cross- 
correlation function of the 'all galaxies' sample, hence the relative bias for the 'all galaxies' sample 
is defined to be unity. The error bars are determined from the one sigma scatter in from the nine 
bootstrap-resampled versions of the survey data. Given that our estimates of £(r) are unreliable 
beyond r ~ 20/i~ 1 Mpc, we see no obvious trend of relative bias with scale in the linear regime. We 
have therefore calculated the maximum-likelihood value of b^ over the range 5-12 /i _1 Mpc, a regime 
over which the assumption of linear bias seems reasonable and where our measurement errors are not 
too large. These values, along with the 95% confidence limits, are given in Table ||[ We also show 
the relative bias bj 3 measured at a separation of r = 17.8/i -1 Mpc in this table. We see that low- 
luminosity galaxies (sample b), are only about one third as strongly clustered as middle- luminosity 
galaxies, in accordance with the findings of Paper 2. High luminosity galaxies (sample d) appear 
to be about thirty percent more strongly clustered than middle-luminosity galaxies, although the 
95% confidence limits do allow for no difference in clustering, again in accord with Paper 2. Early 
type galaxies (e) have a very similar bias parameter to luminous galaxies, whereas late type galaxies 
have a bias parameter midway between that of low and middle-luminosity galaxies. 

The parameter most commonly used for normalizing the power spectrum of clustering models and 
theories to observations is the variance of galaxy counts in 8/i _1 Mpc radius spheres, (cr|) s , 

(^i)s = ^2 J J v ari2)dV 1( lV 2 . (17) 

We estimate (t|) 9 by Monte-Carlo integration of the observed real-space correlation function for 
each of the galaxy samples using 500,000 randomly placed pairs of points inside an 8/i _1 Mpc radius 
sphere. Results are given in Table |!| As we see from Figures || and ^, (<t|) 9 may be mildly affected 
by non-linearity, and so we do not expect 6g and bj 3 to be directly proportional to (o"s)s- Note the 
significant difference in (<r|) 5 for galaxies fainter than L* and those around L* and brighter. 



In Figure 10 we plot estimates of /3? (open symbols) and (3j 3 (solid symbols) for each galaxy sample. 
In order to estimate (3 for galaxy sub-samples, we have measured the redshift-space cross-correlation 
function of the given galaxy sample with the all-galaxies sample using the estimator 

l + ^(s) = Wt9 ^ r fy (18) 
Wtr{S)W gr (s) 

Here the subscript t denotes galaxies of specific type, g denotes all galaxies and r denotes random 
points (cf. eq. ^). Comparing this with the real-space cross correlation function £t g (r) gives an 
estimate of (5 via equation (|5|). Once again, the error bars come from the scatter between bootstrap 
resamplings. Estimates of (3^ and 95% confidence limits over the separation range 5-12 /i _1 Mpc are 
given in Table ^. Clearly, negative values or lower limits on j3 are not physically reasonable, but 
the upper limits are still useful. For instance, for bright galaxies (d) we can say that j3 < 0.9 with 
95% confidence. The value of (3j 3 at r 17.8/i _1 Mpc is also given in Table ||. 

Now, if the 'true' bias factor b\ Iue (ie. the bias with respect to the mass) is related to the relative 
bias factor by b\ rue = bobt, (so that bo is the bias factor for the 'all galaxies' sample) then the product 
bt/3 for each galaxy sample should be a constant equal to 0°' 6 /6o. While we do find some scatter 
in this quantity between the different samples, the results are consistent (S7°' 6 /6o ~ 0.2-0.6) within 
the 95% confidence limits. 
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5 Conclusions 



We have used large and realistic iV-body simulations to investigate the effects of non-linearity on 
two estimators for the quantity (3 (eqs. j|] and ||) in low and high density models. We find that non- 
linearity affects the 2nd order spherical harmonic £2(3) of redshift space clustering to scales as large 
as 30/i~ 1 Mpc. In contrast, the amplitude of the direction-averaged correlation function £o( s ) is only 
weakly affected by non-linearity on scales r > 5/i _1 Mpc in the LCDM model and r > 10/i _1 Mpc 
in the MDM model. Therefore the most practical method for constraining (3 with existing redshift 
surveys is by measuring the amplification of direction-averaged redshift space clustering over real 
space clustering. An alternative approach, modeling the non-linearity, has recently been used by 
Cole et al. (1995) and Fisher and Nusser (1996). These authors also find that j3 < 0.6 from 
independent data sets. 

Measuring the projected cross-correlation of Stromlo-APM galaxies with the parent APM survey 
galaxies enables a reliable determination of £(r) to scales r < 20/i~ 1 Mpc. The ratio shows 
rather large scatter on scales 5-20 /i _1 Mpc, but the integral J3 is less noisy than £(r) and on a scale 
r ~ 17.8/i Mpc, Js(s) / Jz(r) provides the estimate (3 = 0.48 ± 0.12. A reasonable upper limit on 
(3 from this analysis is j3 £ 0.6. Given that the (3j 3 estimates on either side of r ~ 17.8/i _1 Mpc are 
almost consistent with (3 = 0, we regard our analysis as providing an upper limit of (3 < 0.6, rather 
than an actual estimate of (3. Although a little lower than estimates of (3 from peculiar velocity 
analyses (eg. Hudson et al. 1995, who find (3 = 0.74 ± 0.13), the largely unknown systematic errors 
in most current estimates of (3 means they are all fairly consistent. See Dekel (1994) or Strauss and 
Willick (1995) for a review of recent measurements of (3. 

The Stromlo-APM survey is a powerful sample for constraining (3 since the large volume probed 
enables us to reliably measure redshift space galaxy clustering in the linear regime, whereas many 
previous analyses have been limited to measuring £(s) in the non-linear regime. Cross-correlation 
with the fully-sampled APM galaxy survey enables us to measure £(r) much more accurately than 
using the angular correlation function w(6), and thus the technique of using the ratio £( s )/£( r ) 
[or J3(s)/Ja(r)] comes into its own for this survey. The most likely source of systematic error 
in this analysis is in the inversion of the projected correlation function H(<r) to obtain the real 
space correlation function £(r). Comparison of the (3 determinations from the simulations using 
£(r) measured directly from the simulations and via inversion of the projected correlation function 
(§ |3.2| ) suggests that any such error is comparable to or smaller than random errors. 

With linear theory and 2-point clustering statistics alone one cannot separate the contributions of 
fi and b in (3 = Q°.6/b. However, as Gaztahaga and Frieman (1994) have discussed, higher order 
correlations may be used to constrain biasing models. Their analysis of APM galaxies favours a 
linear bias parameter b ~ 1, although to be strictly self-consistent, one should allow for a non- linear 
bias model in non-linear perturbation theory, in which case one can always match the observed 
skewness of APM galaxy counts in cells by adjusting the non- linear bias parameters. Further work 
is clearly required in constraining possible biasing models. 

As we have seen in Paper 2, different classes of galaxy have different clustering properties, and so 
not all galaxies can have exactly the same biasing parameter. In particular, low-luminosity galaxies 
are about three times less strongly clustered than L* galaxies on large scales, and so b^* 36<l*. 
An interesting test would be to see if high order clustering of low-luminosity galaxies also predicts 
a lower value of bias than for L* galaxies. 
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In conclusion, we find that a relatively low value of (3 is favoured by the Stromlo-APM data; our 
results appear to rule out an unbiased, Q = 1 model. We thus conclude that Q, < 1 and/or that 
galaxies are positively biased, ie. more strongly clustered than the underlying mass distribution. 
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Stebbins for pointing out an error in an earlier version of this paper and the anonymous referee who 
suggested that we test our methods on a high-density simulation. JL acknowledges the hospitality 
of the Oxford Physics Department where the final version of this paper was completed. 
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Tables 



Table 1: Power-law fits to real and redshift space clustering in the survey data and simulations. 



Sample 


7s 






so 










ro 




Stromlo - APM 


1.49 ± 


0.15 


5.9 


± 


0.4 


1.71 


± 


0.05 


5.1 ± 


0.2 


LCDM 


1.84 ± 


0.16 


6.1 


± 


0.5 


1.97 


± 


0.12 


6.0 ± 


0.6 


MDM 


1.37 ± 


0.15 


4.3 


± 


0.2 


1.48 


± 


0.09 


3.9 ± 


0.9 



Notes. — 7 S and so are the power-law fit parameters to the correlation function in redshift space 
measured over the range 1.5-30 h~ 1 Mpc. j r and ro are the real-space power-law parameters over 

the range 0.2-20 h _1 Mpc. 



Table 2: Constraints on galaxy peculiar velocities (km s r ) for survey data and simulations. 



Model Gaussian |tt;| 3 / 2 Exponential 

a {w 2 ) l/2 95% conf ln(£) {w 2 ) 1/2 95% conf ln(£) (w 2 ) 1 / 2 95% conf ln(£) 

Survey Data 



1.0 


383 


89 


756 


-10.1 


404 


96 


841 


-9.9 


438 


101 


1095 


-9.9 


3.0 


400 


203 


800 


-3.1 


446 


219 


889 


-2.9 


531 


253 


1081 


-2.6 


5.0 


406 


98 


832 


-3.0 


417 


105 


907 


-2.9 


459 


112 


1093 


-2.9 


7.0 


271 





708 


0.0 


271 





796 


0.0 


282 





1040 


-0.1 



LCDM Simulation 



1.0 


473 


443 


504 


-32.8 


500 


461 


538 


-20.7 


569 


519 


631 


-11.6 


3.0 


452 


388 


524 


2.8 


475 


405 


554 


2.3 


533 


447 


634 


-0.2 


5.0 


228 


153 


299 


7.5 


234 


155 


311 


7.4 


247 


158 


336 


7.1 


7.0 


283 


185 


380 


10.6 


293 


187 


396 


10.5 


310 


191 


432 


10.2 



MDM Simulation 



1.0 


628 


560 


726 


-0.5 


698 


610 


788 


3.6 


847 


743 


975 


5.3 


3.0 


480 


425 


543 


10.3 


513 


453 


585 


10.5 


601 


521 


690 


8.0 


5.0 


472 


395 


566 


8.2 


498 


409 


601 


7.2 


552 


448 


691 


4.9 


7.0 


396 


302 


497 


0.3 


404 


305 


515 


-0.7 


430 


313 


560 


-2.8 
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Table 3: Relative bias and 6j 3 , variance in 8h 1 Mpc cells and redshift space distortion 

factors /?£ and f3j 3 for galaxy subsamples 





Type 


h 


95% 


conf 




Wi) 9 




95% conf 


A/3 


a 


All 


1.00 


1.00 


1.00 


1.00 ± 0.00 


0.89 ±0.05 


0.36 


-0.03 


0.75 


0.48 ±0.12 


b 


Faint 


0.31 


0.05 


0.56 


0.32 ±0.18 


0.40 ±0.10 


1.91 


0.35 


3.46 


0.85 ±0.71 


c 


Middle 


1.05 


0.85 


1.26 


1.15 ±0.13 


1.08 ±0.14 


0.26 


-0.12 


0.65 


0.59 ±0.29 


d 


Bright 


1.34 


0.78 


1.89 


1.45 ±0.35 


1.20 ±0.18 


-0.11 


-1.14 


0.91 


0.19 ±0.43 


e 


E&SO 


1.39 


0.83 


1.95 


1.36 ±0.35 


1.24 ±0.27 


0.44 


-0.13 


0.99 


0.27 ±0.59 


/ 


Sp&Irr 


0.78 


0.62 


0.95 


0.87 ±0.12 


0.66 ±0.05 


0.30 


-0.16 


0.75 


0.33 ±0.45 
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Figure Captions 



Figure 1 A contour plot of the full redshift space correlation function £(<r, tt) measured from the 
Stromlo-APM Redshift Survey as a function of separation parallel (tt) and perpendicular (a) 

[12 11 

to the line of sight and smoothed with a < 2 4 2 > smoothing filter. The contours are 

{ 1 2 1 J 

plotted in fixed steps in log£ from —3 to 1. Solid contours show values £ > 1, dashed contours 
show values £ < 1 (i.e. in the linear regime). 

Figure 2 Comparison of the Stromlo-APM (filled circles), LCDM (open circles) and MDM (open 
squares) correlation functions in (a) redshift space and (b) in real space. 

Figure 3 The redshift-space correlation function £(er, tt) plotted as a function of separation tt along 
the line of sight for four bins in projected separation a. The points with error bars show £(cr, tt) 
calculated from (a) the Stromlo-APM survey, (b) the LCDM simulation and (c) the MDM 
simulation. The curves show predictions for three peculiar velocity distribution functions - 
see text for details. 

Figure 4 (a) The First three spherical harmonics for the redshift-space correlation function mea- 
sured from the LCDM simulations (symbols) and predicted by linear CDM theory (curves). 
Filled circles and the continuous line shows the direction-averaged correlation function (£(})• 
Star symbols and the dashed line show the negative of the quadrupole harmonic (—£2)- Open 
circles and the dotted line show the hexadecapole harmonic (£4). (b) As (a) for the MDM 
simulations. £4 is very noisy for this set of simulations and so is not shown here. 

Figure 5 Estimates of (3 as a function of separation from the LCDM simulations using equation (||), 
(a) uses 'direct' estimation of ^(s) and £(r), (b) uses the projected cross-correlation estimate 
of £(r) (Eq. [?]). The open symbols show (3 estimated from the ratio C( s )/C( r ) an d the solid 
symbols show (3 estimated from the ratio Jz(s) / J%(r) . The horizontal unbroken line shows 
the maximum-likelihood fit to [3^ over the range indicated and the dotted lines show 95% 
confidence limits on this (3 estimate. The horizontal dashed line indicates the actual (3 = 0.38 
for these simulations. 

Figure 6 As Figure || but for the MDM simulations. 

Figure 7 The 0th and 2nd order spherical harmonics of the redshift-space correlation function 
measured from the Stromlo-APM survey. The curves are from LCDM linear theory (light 
lines) and MDM theory (heavy lines). 

Figure 8 Estimates of (3 as a function of separation for the Stromlo-APM survey data from the 
ratio £(s)/£(r) (open circles) and J%(s) / J%(r) (filled circles). 

Figure 9 Relative bias factors for subsamples of the Stromlo-APM Survey, determined from the 
ratio itg{i~) I £,gg( r ) (open circles) and J^ tg (r) / J3" (r) (filled circles). The horizontal lines show 
the maximum likelihood fit to Ctg{ r ) / £,gg{ r ) over the range 5-12 /i _1 Mpc; the dashed lines 
show the 95% confidence limits. 

Figure 10 Estimates of (3 for subsamples of the Stromlo-APM Survey, determined from the ratio 
Ctg(s) I Ct g {r) (open circles) and J3 9 (s) j J3 9 (r) (filled circles). 
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